Description:

IBM Consulting is hiring an Azure Data Platform Engineer to join its FutureNow Delivery Center in Bangalore. In this role, you will act as a technical advisor and hands-on developer responsible for designing, building, and operating hybrid batch and real-time data ingestion pipelines across the Microsoft Azure cloud landscape. The work involves managing structured and unstructured data tiers, creating highly performant analytical compute layers, and integrating modern open-source data orchestration tools. You will closely collaborate with cross-functional global squads to implement advanced data warehousing architectures, manage message queues, and support corporate cloud-and-AI customer journeys with up to 20% local travel flexibility.

Key Technologies:

Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, Event Hub, SQL DW, Cosmos DB, ADLS2, Blob Storage, Azure Functions, Azure Purview, Streaming Analytics, Apache Kafka, Apache Airflow, dbt, Spark, Python, Scala

Requirements:

• Bachelor’s Degree in Computer Science, Information Technology, Data Engineering, or a related discipline (Master's Degree is preferred).
• 3–5 years of professional technology experience handling end-to-end cloud data pipeline engineering, processing, and management layers.
• Proven experience utilizing core cloud tools—specifically Azure Data Factory (ADF) for orchestrating activities, Azure DataBricks for transformation, and Azure Synapse Analytics for unified data optimization.
• Advanced infrastructure manipulation skills using Azure Data Lake Storage Gen2 (ADLS2), Azure Blob Storage clusters, relational setups like SQL Data Warehouse (SQLDW), and NoSQL distributed transactional stores via Cosmos DB.
• Practical execution knowledge managing event-driven streaming applications using Azure Event Hubs, Azure Streaming Analytics engines, or Managed Streaming for Apache Kafka clusters.
• Hands-on integration capabilities deploying open-source components including Apache Airflow for data workflow management, dbt (data build tool) for SQL transformations, and building data processing layers using Spark coupled with Python or Scala frameworks.
• Experience scripting automated serverless pipelines using Azure Functions with Python, alongside maintaining data access rules and catalog compliance tracking via Azure Purview.
• Active curiosity, highly collaborative mindset, strong technical communication abilities, and an analytical troubleshooting posture to drive business value across private and public enterprise sectors.